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Abstract 

Consider the following birth and death process with the following infinitesimal transition prob- 
abilities Afe = j^T/j: an< A Mfe — with A, /i > 0. This process has known as a discouragement 
queue [5]. 

Although from the theoretical point of view the problem of the determination of the transition 
functions has been solved [J], the explicit form of them is not present in literature. 
We have solved this problem assuming that the solution is representable by a Taylor series, 
under the initial condition that the process starts to state zero. 

We discuss also the same problem for the embedded chain and using direct computation we 
obtain a recursive formula for the transient distribution. 



1 Introduction 

The problem to find an explicit formula of the transition probabilities for this particular queue is 
proposed by Natvig [5]. 

Parthasarathy et al. [5] give an explicit solution, based on continued fractions approach, for the 
cases Afc = and [i^ — k and A& = A and /x^ = /ik, with A, fj, > 0. 

Despite the powerful of continued fractions approach, for our case this method seems to be fail. 
We propose a more simple approach based on the Taylor expansion, and recognize a simple iterative 
formula for the coefficients of the series. Our approach permits a fast numerically calculation of the 
coefficients. 

Unexpectedly the bound we used for the coefficients, to verify the total convergence of the Taylor 
series, is related with the Bessel Numbers [2]. 



2 Transient solution in continuous time 

We remember that that the infinitesimal transition probabilities are given by 

'j^h + o(h), if m = l 
P(X(t + h) = n + m\X(t) = n) = { o(h), if \m\ > 1 



[ikh + o(h), if m = — 1 



Let q(k,t) = P{X{t) = k) then 
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g'(0,i) = -Ac?(tM)+ W (M) 



q'(k,t) = %q(k-l,t) - (f^+kfi) + {k + + l,t), Vfc > 1 



(1) 

Let t = At, p(k,r) = q(k,t(r)), a = and p(k,r) = j<j(k,t), then <jT5j) is equivalent to 
J p(0,r) = -p(0,r) + a 2 p(l,T) 

i p(fc, r) = ±p(/e - 1, t) - + fca 2 ) p(fc, r) + (fc + l)a 2 p(fc + 1, r), Vfc > 1 (2) 

We consider © under the initial conditions 

p(0,0) = l, p(k,0) = Q Vfc>0 

Let us observe that the functions p(k, •) have derivatives of any orders. This observations suggest 
a Taylor series expansion for p{k, r), k > 0, and in particular for p(0, r). 

For sake of simplicity we put p(k, r) = w ^t'^ , then the p(k, r), r > 0, satisfy if and only if the 
w(fc, r), fc > 0, satisfy 



iu(0, r) = — w(0, t) + aw(l, r) 

w(fc, r) = aw(k — 1, r) — ^yq^: + fca 2 ^ w(k, r) + aw(k + l,r), Vfc > 1 



(3) 



with the initial conditions w(0,0) = 1, w(k, 0) = 0. 
Let 6fc = + fca 2 , fc > 0, we observe that if 



+ 0O 

T 



(°< r ) = E-r» r ° = 1 ( 4 ) 



i=0 



then 



1 \ - T 



! +°° r i 

if (2, r) = — V" — -[r i+2 + feo^i+i + h(r i+ i + b n) - a 2 r. 



i=0 



1 +oo r » 

j(3,t) = — X! ~]"{( r «+3 +6on+2) +&i(n+2 + b a r i+ i) - a 2 r i+1 - 
i=0 4 



+ b 2 [n+2 + b r i+ i + h(r i+ i + b n) - a 2 r t ] - a 2 {n +1 + b n)}; 
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So that if we put = Ti, S[ = for all i > and = for all n > i, by recursion we 



s ( k+1) = ^ + _ a 2 5 (fc-i) ; vi > 0, < fc < i + 1 



so that 



and obviously 



i +°° i 



a 2k kl c — ' i\ 

i=Q 



Proposition 2.1. Let Sq ^ = 1 and L> = 1, for all i > 0, then $5$ is equivalent to 



furthermore 



S ( k k) = 1, Vfc > 



CUi = E« 2(fc ~ l 



, h 7 k>0 



Proof 



(|8) is obvious. To prove ([9]) we proceed by induction. 
Thesis is true for n = because 



« 1 =^r i) -^ o) +4 i) =E' 



-2/ 



i=0 



L 0(0 I C'( i + 1 ) 



then supposing it is true for fc > we have 



c(*+l) -„2<;(H1-1)_, o(M-l) , <j(fe+l+l) 

J (fc+l) + ?i+l — " °fc+l+/i °k+l+h "T J fe+l + /i 



i=0 



h _1_ o( i+1 ) 



(fe+1) , g(fc+2) 



E 1 

i=0 



2(fc+l-i) 



+ Q 2(fc+l-(fc+l)) 



, o(fc+l) o((fe+l) + l) 
-0fc+l<5 fe+1+/l + b k +l+h 



fe+1 
i=0 



?> _i_ cC^+i) 



To establish the convergence of the Taylor series (JT]) we observe that if we put 



□ 



T (k) ^_ Mk) 

L i ~ a 2k b i 



(10) 



from §5$ we have 



-(fe) _ r (fc-l) , , r (fe) , 2r(t+l) 



J i+1 — 



+ " + a z L^ L > , Vi > 0, < fe < » + 1 



and 



=0, Vi > 0; Lf ) = 0, Vfc > i; Lf = 1, Vi > 



It is obvious that such L\ are non negative for all i, k = 0, 1, 2, ... and moreover if we put 7 
max(l,Q 2 ) we have 



Lf <MfV ( *~ fe) , Vfc, i = 0,1, 2, 



(11) 



(fe) 

where the M; are such that 



= Mi fc_1) 



+ (l + fc)J\4 fc) +Af/ fc+1) , Vi>0, 0<fc<i+l 
M ( ~ 1] =0, Vi > 0; M[ k) =0, Vfc > i; Aff } = 1, Vi > 



(12) 



(k) 

Computing the M> ' , we obtain that 



where the B* are the so called Bessel numbers. This last assertion derives from the comparison 
of the generating function related to the solution of the equations (|T2"j). see [T| for more details 
(paragraph 7.3), and the generating function of the Bessel Number proposed in [2]. 

In P] it is proved that Bessel numbers have the asymptotic form 

1 w i+3 

where w ~ 2 in(z) * s Positive root of following equation: 

i + 2 = 2wln(w) 

Then, apart from sub-exponential factors, Bessel numbers grown like 



BtK \^W)) (13) 

From (fT3")) it follows that the power series 



1=0 



has an infinite convergence radius. 

Therefore taking into account (jlip by the convergence of (|14p. we conclude that the series at the 
second member of © is a power series with infinite convergence radius. 

In conclusion we have established the following theorem. 

Theorem 2.2. The Cauchy problem Q) has a unique solution p(k, r), k = 0, 1, 2, where p(k, r), 
t > 0, are defined in P7[). 
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3 Embedded chain 



We start with the general state dependent case and we recover the solution of our problem as 
corollary of the general case. 

We consider now the following birth and death process with infinitesimal transition probabilities 

Xkh + o(h), if m = l 
P(X(t + h) = k + m\X(t) = k) = { o(h), if \m\ > 1 



fikh + o(h), if m = —1 



Let p(k,t) = P(X(t) = k) then 

p'(0,t) = -\p(0,t) + W (l,t) 



p'(k, t) = X k -xp(k - 1, t) - (A* + n k )p(k, t) + n k+lP (k + 1, t), Vfc > 1 



Definition 3.1. v4 stochastic process {X(t)} t >o taking its values in the countable state space E is 
a called jump process if for the almost w G f2 and all t >0, there exists e(t,oS) > such that 

X{t + s,uj) =X(t,u), Vs G [t,t + e(t,w)) 

It is called regular jump process if in addiction, for almost all lo £ £1, the set A(u>) of discontinuities 
of the function t — > X(t, uS) is a— discrete, that is, for all c > 

\A(uj) n [0,c]| < +oo 

where the notation \B\ is the cardinality of set \B\. A regular jump homogeneus Markov chain is 
by definition a continuous time HMC that is also regular jump process. 

Let {r„} be a non decreasing sequence of transition times of the regular jump process {X(t)} t >o 
where tq — and r„ = oo if there are strictly fewer than n transitions in (0, oo). 

The process {X„}„>o with value in E& = E U A, where A is an arbitrary element not in E, is 
defined by X n = X(r n ) with the convention X(oo) = A, and it is called embedded process of the 
jump process. 

The associated embedded process, see [3], has transition probabilities of the form 

Pi,j = J^f i > J=* + l, *>1 

Pi,j = xfrjr i , j = i-i, *>1 

Pi,j = 1, .7 = 1, i = 
Pi_j = otherwise 

Now consider the associated embedded processes {X n } n >o of (fT5|) . 
Let P(X n =k)= p„, fc then 



Pn + ^ = J^fk^Pn,k-l + J^^Pn,k + l, Vn > 0, l<fc<n+l 

=0, Vfc > n 
Pn-i = 0, Vn > 
Po : o = 1 

The next two following lemma are elementary and they will be explained without proofs. 



G 



Lemma 3.2. Let (p n ,k)n,k>o be the matrix defined in 1116]) then 




Vn > 



+ oo 

(ii) y^p n ,fc = 1, Vn > 
k=a 

From (fTO|) it follows obviously the following lemma. 

Lemma 3.3. In the hypothesis of lemma (ff.ff)) . if n + k is odd then p n ,k = 0. 
By virtue of Lemma (|3.2p and Lemma (|3.3p we can find the transient distribution. 
Proposition 3.4. Let (p n .k)n.k>o as in S16\) then 

{Pn.k = Ili=o (a~+^~) T ^,fc> n ^ °> < fc < n, n + fc even, 
Pn.fc = 0, otherwise 

where 

T h ,k = V t— ^ — f 1 - x Vk>0,h>l; T , fc = l, Vfc>0 

Mi \ M+\ + fJ-l+i J 

Proof 

We know from the lemma (|3.3[) that if n + fc is odd then p n> k ~ 0, furthermore it holds that 

d k ■■= Pk.k = TT ( t ~~ — ) 

Let ?i = fc + 2/i, we want prove that 

Pk+2h,k = d k T h ,k, Vfc > 0, h > 
Fixed fc, we proceed by induction on h. The (|T9]) is true for /i = being 

supposing it is true for h we prove it for h + 1. Let := x ^ - from f|16[) we have 



Pk+2(h+l).k — Pk+2h+lM-lCtk-l + Pk+2h+lM+l&k+l — 

= Pk+2h+lM-lOik-l + [1 — Ckfe +1 ]p fc+2 /i+l,fc+l 



and by the inductive hypothesis (|19p . it follows that 



Pk+2(h+l),k — Pk+2h+\,k-lOtk-l + [1 — a k+ i]d k+ iTh, k +l 

Taking into account (jT5J) we have 

Pk+2(h+l),k = Pk+2h+l,k-lOtk-l + (dk+i - d k+2 )T h ^ + i (20) 
On other hand for every fixed h, setting 

h\ = pk+2h+i,k-iUk-i (21) 

we have (to show) 



b h =0 

b\ = dk E-=o d -^^T h , +u Vfc > 1 



(22) 

In fact proceeding by induction also in this case, we have that (|22|) is true for k = 0, being 
P2h+i,-i = 0. Furthermore it is true for k = 1 because for (|2"T1) it holds that 

b'l = P2+2h.Q 

and from we have 



b'l = Pl+2h.-l + (1 - Ul)Pl+2h,l = (1 - Cti)p 1+2 h,l 

thus by inductive hypothesis on h it follows that 

b'i = (1 - a x )diT h i = (rfi - d 2 )T h ,i = d x — , ^ '' T hA 

do 

being do = d\ = 1. 

Now supposing that (|2"2"j) is true for fc > 1 . we prove it for k + 1 : 

frfc+l = Pk+l+2h+l,kUk = 

= a k \pk+l+2h,kOCk + (1 - afc+l)Pfe+l+2h,A;+l] 

for the (|2"Tj) and by inductive hypothesis on /i (fTT))) we obtain 

b k+1 = afc[fefc + (1 - a k+1 )d k+1 T htk+1 ] 



furthermore by inductive hypothesis on k (|22p we have 
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k-l 



dk ^ ' +1 , — -^—Thj+i + (1 — ak+i)dk+\Th,k+\ 



i=0 



fc-i 



rffc ^ ' +1 , — — Th } i + i + (dk+i — dk+2)Th,k+\ 



i=0 



otkdk 



di+\ — di+2 



i=0 



= d k+ i 



di+\ — di + 2 



Now for h fixed the (f2~Tj) is true, substituting (|2T|) in (f2"U)) finally we obtain 



Pfc+2(/i+i),fc — rffc+i E ' +1 , — —Th,i+i + (dk+i - d k+2 )T h ^ + i — 



dk+i 



E 

i=0 



d l+ i~d l+2 d k+ i - d k+2 

-J-h,i+l H j J/t,fc+l 



dk+i 



then the thesis follows. 



fc+i 



, d i+1 - dj+2 (h) _, rp 

a-k+i T — dk+iJ-h+i,k 



i=0 



□ 



As an immediate corollary of the proposition 13.41 we have the following: 

Corollary 3.5. Let (p n .k)n.k>o as i n Q W with X k = and \i k = /ifcl{- fc>1 -j with X,/j,>0, then 



(—) 

Pn.k — d k T^ 2 , n> 0, < k < n, n + k even 
Pn.k = 0, otherwise 



(23) 



where 



k x 

4 = n i +l u-i) a 



{i-l)c 

lf> =J2 di+1 ~ di+2 T^~ 1 \ 
i=0 l 
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